Assessing the Usability and Feasibility of Digital Assistant Tools for Direct Support Professionals: Participatory Design and Pilot-Testing.

BACKGROUND: The United States is experiencing a direct support professional (DSP) crisis, with demand far exceeding supply. Although generating documentation is a critical responsibility, it is one of the most wearisome aspects of DSPs' jobs. Technology that enables DSPs to log informal time-stamped notes throughout their shift could help reduce the burden of end-of-shift documentation and increase job satisfaction, which in turn could improve the quality of life of the individuals with intellectual and developmental disabilities (IDDs) whom DSPs support. However, DSPs, with varied ages, levels of education, and comfort using technology, are not likely to adopt tools that detract from caregiving responsibilities or increase workload; therefore, technological tools for them must be relatively simple, extremely intuitive, and provide highly valued capabilities. OBJECTIVE: This paper describes the development and pilot-testing of a digital assistant tool (DAT) that enables DSPs to create informal notes throughout their shifts and use these notes to facilitate end-of-shift documentation. The purpose of the pilot study was to assess the usability and feasibility of the DAT. METHODS: The research team applied an established user-centered participatory design process to design, develop, and test the DAT prototypes between May 2020 and April 2023. Pilot-testing entailed having 14 DSPs who support adults with IDDs use the first full implementation of the DAT prototypes during 2 or 3 successive work shifts and fill out demographic and usability questionnaires. RESULTS: Participants used the DAT prototypes to create notes and help generate end-of-shift reports. The System Usability Scale score of 81.79 indicates that they found the prototypes easy to use. Survey responses imply that using the DAT made it easier for participants to produce required documentation and suggest that they would adopt the DAT if this tool were available for daily use. CONCLUSIONS: Simple technologies such as the DAT prototypes, which enable DSPs to use mobile devices to log time-stamped notes throughout their shift with minimal effort and use the notes to help write reports, have the potential to both reduce the burden associated with producing documentation and enhance the quality (level of detail and accuracy) of this documentation. This could help to increase job satisfaction and reduce turnover in DSPs, both of which would help improve the quality of life of the individuals with IDDs whom they support. The pilot test results indicate that DSPs found the DAT easy to use. Next steps include (1) producing more robust versions of the DAT with additional capabilities, such as storing data locally on mobile devices when Wi-Fi is not available; and (2) eliciting input from agency directors, families, and others who use data about adults with IDDs to help care for them to ensure that data produced by DSPs are relevant and useful.

"You get what you need when you need it": A mixed methods examination of the feasibility and acceptability of a tailored digital tool to promote physical activity among women in midlife.

During midlife (ages 40-60), women experience myriad changes that elevate their risk for cardiovascular disease (CVD), including decreased physical activity (PA). Women cite lack of social support for PA and lack of active peers who can serve as role models as key barriers. Digital tools such as web applications can provide exposure to these social inputs; they are also accessible in daily life and require modest time investment. However, as few tools have been designed to meet the unique needs of women in midlife with CVD risk, our research team previously built a web application that is tailored for this population. In the present study, we used a convergent mixed methods design to develop a deep understanding of the feasibility, usability, and acceptability of this web application in a sample of identified end users. Participants (N = 27, MAge = 53 years, MBMI = 32.6 kg/m2) used the web application at the start of each day for 7 days and completed a 1-hour qualitative interview at the end of this test period. Integration of findings from two-level multilevel models (quantitative) and thematic analysis (qualitative) indicated support for the feasibility, usability, and acceptability of the new web application among women in midlife with CVD risk conditions and identified critical opportunities for improving the user experience. Findings also speak to the utility of options for content selection that can meet women's needs in daily life and highlight women's desire for PA resources that prioritize their perspectives.

Direct Support Professionals' Perspectives on Using Technology to Help Support Adults With Autism Spectrum Disorder: Mixed Methods Study.

BACKGROUND: Documentation is a critical responsibility for direct support professionals (DSPs) who work with adults with autism spectrum disorder (ASD); however, it contributes significantly to their workload. Targeted efforts must be made to mitigate the burden of necessary data collection and documentation, which contributes to high DSP turnover rates and poor job satisfaction. OBJECTIVE: This mixed methods study aimed to explore how technology could assist DSPs who work with adults with ASD and prioritize aspects of technology that would be most useful for future development efforts. METHODS: In the first study, 15 DSPs who worked with adults with ASD participated in 1 of the 3 online focus groups. The topics included daily tasks, factors that would influence the adoption of technology, and how DSPs would like to interact with technologies to provide information about their clients. Responses were thematically analyzed across focus groups and ranked by salience. In the second study, 153 DSPs across the United States rated the usefulness of technology features and data entry methods and provided qualitative responses on their concerns regarding the use of technology for data collection and documentation. Quantitative responses were ranked based on their usefulness across participants, and rank-order correlations were calculated between different work settings and age groups. The qualitative responses were thematically analyzed. RESULTS: In study 1, participants described difficulties with paper-and-pencil data collection, noted benefits and concerns about using technology instead, identified benefits and concerns about particular technology features, and specified work-environment factors that impact data collection. In study 2, participants rated multiple features of technology as useful, with the highest usefulness percentages endorsed for task views (ie, by shift, client, and DSP), logging completed tasks, and setting reminders for specific tasks. Participants also rated most data entry methods (eg, typing on a phone or tablet, typing on a keyboard, and choosing from options on a touch screen) as useful. Rank-order correlations indicated that the usefulness of technology features and data entry methods differed across work settings and age groups. Across both studies, DSPs cited some concerns with technology, such as confidentiality, reliability and accuracy, complexity and efficiency, and data loss from technology failure. CONCLUSIONS: Understanding the challenges faced by DSPs who work with adults with ASD, and their thoughts about using technology to meet those challenges, represents an essential first step toward developing technology solutions that can increase DSPs' effectiveness and job satisfaction. The survey results indicate that technology innovations should incorporate multiple features to account for different needs across DSPs, settings, and age groups. Future research should explore barriers to adopting data collection and documentation tools and elicit input from agency directors, families, and others interested in reviewing data about adults with ASD.

Development and Initial Testing of a Personalized, Adaptive, and Socially Focused Web Tool to Support Physical Activity Among Women in Midlife: Multidisciplinary and User-Centered Design Approach.

BACKGROUND: Women in midlife are vulnerable to developing cardiovascular disease, particularly those who have conditions such as hypertension. Physical activity (PA) can reduce risk, but efforts to promote PA in this population have been only modestly effective. More attention to social influences on PA behavior may be useful, particularly social support and social comparison processes. Activating these processes with digital tools can provide easy access that is flexible to the needs of women in midlife. OBJECTIVE: This paper describes the user-centered design processes of developing and conducting initial evaluation of a personalized and adaptive web application, tailored to the social needs of women in midlife. The goal was to gather feedback from the population of interest, before and during the design process. METHODS: This study was conducted in 4 stages. The first and second authors (DA and AFL) developed technical specifications, informed by their experience with the population of interest. We collected feedback on potential content for the web application with women in midlife using both interviews (5/10, 50%; mean age 47.4, SD 6.66 years; mean BMI 35.3, SD 9.55 kg/m2) and surveys (5/10, 50%; mean age 51, SD 6.60 years; mean BMI 32.7, SD 8.39 kg/m2). We used their feedback to inform support messages and peer profiles (ie, sources of social comparison information). Nine members of the behavioral science team and 3 testers unfamiliar with the web application completed internal testing. We conducted naturalistic functionality testing with a different group of women in midlife (n=5; mean age 50, SD 6.26 years; mean BMI 30.1, SD 5.83 kg/m2), who used the web application as intended for 4 days and provided feedback at the end of this period. RESULTS: Iterative storyboard development resulted in programming specifications for a prototype of the web application. We used content feedback to select and refine the support messages and peer profiles to be added. The following 2 rounds of internal testing identified bugs and other problems regarding the web application's functioning and full data collection procedure. Problems were addressed or logged for future consideration. Naturalistic functionality testing revealed minimal further problems; findings showed preliminary acceptability of the web application and suggested that women may select different social content across days. CONCLUSIONS: A multidisciplinary and user-centered design approach led to a personalized and adaptive web application, tailored to the social needs of women in midlife. Findings from testing with this population demonstrated the feasibility and acceptability of the new application and supported further development toward its use in daily life. We describe several potential uses of the web application and next steps for its development. We also discuss the lessons learned and offer recommendations for future collaborations between behavioral and computer scientists to develop similar tools.